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ABSTRACT 

The quenched free energy of spin glasses can be estimated by means of annealed 
averages where the frustration or other self-averaging variables of disorder are 
constrained to their average value. We discuss the case of (i-dimensional Ising models 
with random nearest neighbour coupling, and for ±J spin glasses we introduce a 
new method to obtain constrained annealed averages without recurring to Lagrange 
multipliers. It requires to perform quenched averages either on small volumes in an 
analytic way, or on finite size strips via products of random transfer matrices. We 
thus give a sequence of converging lower bounds for the quenched free energy of 2d 
spin glasses. 

PACS NUMBERS: 05.50.+q, 02.50.+S, 75.10.N 
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1. Introduction 

Disordered systems are made of random variables which relax to equilibrium on 
very different time scales. For instance in the standard models of spin glass, the 
spins arrange themselves to minimize the free energy while the random couplings 
are assumed to be frozen in their initial values, since their evolution time is much 
longer. As a consequence, one should consider different kinds of averages: quenched 
averages for the frozen variables, and annealed averages for the fast variables. However, 
it is much easier to compute annealed averages, which give lower bounds of the 
quenched free energy, the physically relevant quantity. These bounds are often very 
poor estimates, since in annealed averages the main contribution comes from a set 
of disorder realizations which have zero probability in the thermodynamic limit. In 
those realizations, the quenched random variables are arranged in order to minimize 
the free energy, at difference with a typical sample of the system where they are frozen 
in a given realization. 

The idea of constrained annealing is to perform annealed averages where the 
random variables are partly frozen by the requirement of satisfying appropriate 
constraints, related to some disorder self-averaging variables. The standard way to 
impose a constraint is by a Lagrange multiplier. By that method, the constrained 
annealed average allows one to introduce a sort of Gibbs thermodynamic potential, 
depending on the temperature and on the Lagrange multipliers which play the role 
of the chemical potential in ordinary statistical mechanics [1] . In the thermodynamic 
limit, the values of the multipliers that maximize the Gibbs potential are those ones 
that select the realizations with a correct value of the disorder intensive variables, and, 
at the same time, that minimize the difference between the mean free energy density 
and its annealed approximations. 
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Constrained annealing for disordered systems has been proposed and applied in 
particular contexts by many authors (see [2], [3], [4], [5], [6]). A general formulation 
of the method and its physical meaning can be found in [1] . 

The purpose of this paper is to show that it is possible to perform constrained 
annealed averages without Lagrange multipliers, in d-dimensional spin glasses with 
dichotomic random couplings in terms of a quenched average over a finite size sub- 
system . This is often possible either in an analytic or in a numeric way. Using our 
method, we are able to obtain very good lower bounds of the quenched free energy of 
two dimensional spin glasses. 

The summary of the paper is the following: 

In section 2, we recall some basic facts about spin glasses. We also classify the set 
of the constraints necessary to recover the quenched free energy by annealed averages. 
In section 3, we study the Ising model with couplings which can assume the values 
Jij = ±1 with equal probability ( the so-called ±J spin glass). In section 4, we 
introduce our method to obtain constrained annealed averages without recurring to 
Lagrange multipliers in the ± J spin glass. In section 5, we apply the method to loops 
of infinite length using the Lyapunov exponent of product of random transfer matrices. 
We are thus able to get accurate estimates of the free energy in two dimensions. 

2. Constraints for d-dimensional spin glasses 

Spin glasses are the challenge of constrained annealing. In that case, the relevant 
variables to be constrained should be related to frustration [7], as first remarked by 
Toulouse and Vannimenus in 1976 [5]. As far as we know, there are only Montecarlo 
simulations, see e.g. [8], [9] , which used that idea while no analytic calculations 
have been performed on that ground. However, it is possible to get analytic results 
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in dimension d > 2 with constraints connected to frustration. Let us consider d- 
dimensional Ising models with nearest neighbour couphngs which are independent 
identically distributed (i.i.d.) random variables, in absence of external magnetic field. 
The partition function is 

Zn = J2]1 exp{/3 (7^(7,} (2.1) 

where the product runs over i,j which are nearest neighbours. Using standard 
relations of the hyperbolic functions, (2.1) becomes 

Ziv = J] n cosh(/3 Jy ) [ 1 + aiaj tanh(/3Jy ) ] (2.2) 

This form is useful since shows that the non-trivial part of the partition function 
is given by riijfl + CTjUj tanh(/?Jy)]. A typical term in that product is 
(7i(7jajai ■ ■ ■ tanh(/3 Jy) tanh(/3 Jj/) • • •, where the bonds {i, j}, {j, /} • • • can form either 
a closed or an open line on the lattice. If the bonds form an open line, at least two 
distinct spin variables survive as factor of the product of the various tanh(/3Jij), and 
the related term gives a zero contribution to the partition function, after performing 
the sum over the a configurations. As a consequence, one has to consider only the 
terms corresponding to bonds which form a closed line (where the product of the d's 
is equal to unity since they appear twice) so that (2.2) can be written as a sum over 
all the possible loops L\ , where r > 4 indicates the length of the loop (r has to be 
even) and s labels different loops with the same length: 

Z^ = e^^..'"'^°^^^^-'^^^2^ ^ n tanh(M,)| (2.3) 

It follows that in a system with a finite number N of spins, the free energy of a disorder 
realization is given by 

y^^-±-\nZr, = ~[B + F^{t('\ t(«))) (2.4) 
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where R is the maximum possible length of a loop in the system {R < const N), and 

5 = ln2 + ^^IncoshipJij) (2.4a) 



N 



and 



F^(t(^),...,t(«)) = lln(l+ Y: *n (2.46) 

\ {Li-'} J 

This function depends on the new set of variables 

= n tanh(/3Jy) (2.4c) 

(r) 

given by products which run on the loops Lg , i.e. plaquettes of larger and larger 
perimeter at increasing r. For instance, the loop L*^^-* is the elementary plaquette of 
four bonds. Let us stress that a loop L^'^^ can be built up as a set of two (or more) 
distinct and separate loops L^'^'^^ and L*^''^) -with ri + r2 = r. In the following we often 
label a coupling by only one label instead of two ones, i.e. Jki is denoted by Jk, since 
there is no risk of ambiguity on a closed line. 

As the number of the nearest neighbour couplings in a hypercubic d-dimensional 
lattice is dN, in the thermodynamic limit the quenched free energy reads 

/ = lim = [ d lncosh(/3Jy ) + F + ln2 ] (2.5) 

iV— i-oo p 



where 

F= lim 4ln[ 1+ y ti"^^ ] (2.6) 

The reduction of the partition function (2.1) into (2.3) is the procedure used in the 
Kac and Ward solution of the 2d Ising model without disorder. 

Eq (2.5) is fundamental since it shows that the quenched free energy depends only 



on the distributions of the variables t^^^, apart the mean value lncosh(/?Jy ). The 
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relevant variables to be fixed to their mean value in a constrained annealed average of 
the free energy are related, with increasing difficulty 

1) lncosh/?Jy 

2) =tanh(/3Ji)tanh(/3J2)tanh(/3J3)tanh(/3J4) 

3) t^^) with r > 6 (considering only connected loops). 

Fixing all the constraints corresponding to those quantities in an annealed average 
is equivalent to solve the system with quenched disorder. This can be understood 
noting that in (2.6) we have a sum over all the possible t^/K Because of the law 
of the large numbers the rescaled sum of the t-variables corresponding to the same 
topological kind of loops self-averages to its quenched mean value. Moreover, in the 
appendix we shall prove that this result holds even in a finite volume system for a 
±J spin glass: the quenched free energy can be obtained by a minimization of the 
logarithm of the annealed average of a Grand-partition function with respect to the 
Lagrange multipliers related to the variables t^^^ over all the possible loops of the finite 
system. For a generic distribution of the couplings, an extension of this statement is 
possible. 

In one dimension there are no loops, so that the constraint related to point 1) 
is sufficient to obtain the exact solution. In general, we expect that many physical 
features of a spin glass can be reproduced already by considering the first two points. 

The case of random couplings Jy = ±1 with equal probability is particularly 
simple in this respect, since the variable In cosh 13 Jij is a constant and thus can be 
ignored. Moreover, one immediately sees that (2.4c) becomes 

= tanh'"(/?) n -^^^ (2.7) 

implying that the quenched free energy only depends on the values of the product of 
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Jij on closed lines of bonds. The non trivial part of the free energy j/jv in (2.4) is thus 

Fjv = ln(l + a;4 tanh^(/?) + xq tanh^(/5) + • • •) (2.8) 

where the coefficients {0:4, a^e, • " •} ^ire non-independent random quantities. As a 
consequence, the quenched free energy is 
1 



/ = I (ilncosh/3 + ln2+ lim — ln(l + 0:4 tanh^(/3) + tanh^ (/?) + •• •) 

p \ iV— >oo N 

(2.9) 

In the annealed model, the last non-trivial term of (2.9) vanishes since = for all i's 
(each Xi is a sum of products of independent random couplings) . In the limit of high 
temperature (/? ^ 0), the difference between annealed free energy and quenched free 
energy thus is of order tanh^ (3 ~ More important, the simplest relevant constraint 
in the ± J spin glass is the frustration Jp on the elementary square plaquette of four 
couplings Ji, J2, J3, J4:, that is 

Jp = -J1J2J3J4 (2.10) 

since t^'^^ — — Jp tanh^/3. 
3. ±J spin glasses 

In this section we consider a d- dimensional spin glass with i.i.d. nearest neighbour 
couplings which assume two possible value = ±1 with equal probability. From 
(2.9), one sees that the annealed free energy density is 

/a = (ln2 + dlncosh/3) (3.1) 

In one dimension, there are no loops and fa is equal to the quenched free energy 
density /, since lncosh/?Jy is a constant, at difference with the gaussian case where 
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that variable is random and has to be constrained in order to recover / [10]. In 
section 2, we have recalled standard results which show that it is necessary to constrain 
variables associated to the loop variable t^'^\ in order to improve (3.1). As first noted 
by Toulouse and Vannimenus [5] , one has to consider the intensive variable 

«^ = ^ E -^^^ (3.2) 
{Li''} 

with has zero mean value, on — 0. Let us remark that it is a self-averaging quantity, 
that is limjv-xx) ctjv = for almost all disorder realizations. The related constrained 
annealed average can be regarded as the Grand-partition function 



In the thermodynamic limit the Lagrange multiplier /x that maximizes 

g{(3,n) = - ]im lnOjv(/3, A*) 

AT— »oo piV 

fixes the frustration on square plaquettes to its mean value. Moreover it is simple to 
show the following inequality: 

In our case, we have to compute 



^^iv(/3,/i) = ^exp{^/3JyCTjCTj - ^ nJp} (3.3) 

{^} {L^^)} 

Taking into account that the couplings are dichotomic with equal probability, one can 
perform the gauge transformation Jjj — > JijaiCTj which leaves unchanged the free 
energy of a disorder realization of the system as well as Jp, i.e. Jp —>■ Jp. As a 
consequence, (3.3) becomes 



QNiP, fi) = 2^ exp{ J] pjij - J2 ^'Jp} (3-4) 

id {lW} 



This expression (which is meaningful for any dimension d > 2) cannot be computed 
exactly including all the possible square plaquettes Lg^-* of the d-dimensional lattice. 
It can be shown that the problem is equivalent to solve a d-dimensional gauge model 
without disorder, whose solution is not known for d>2. 

However, an exact solution can be achieved if we restrict the sum (3.4) only on a 
part (of order N) of the plaquettes. In other terms the constraint is imposed over a 
fraction of the plaquettes, that is we are able to partially fix the plaquette frustration to 
its mean value. As a consequence, the annealed system exhibits a 'residual' frustration 
related to the non-constrained plaquettes. 

Let us consider the 2d model. It is convenient to limit ourselves to consider one 
half of the plaquettes, which must be chosen in such a way that they do not share any 
coupling, as it happens for the black squares of a chessboard. With this restriction 
(3.4) contains a sum over products of N/2 independent variables (corresponding to 
the N/2 black plaquettes) and the Grand-partition function can be rewritten as: 

f]Ar(//) = 2^ (exp{/3( Ji + J2 + Jg + J4) + J3 J4}) ' (3.5) 

where Ji , J2 , J3 , are the couplings of one of the plaquettes. After maximizing 
with respect to the Gibbs potential [1], one obtains 

/ac' = -^{^ln2 + ^lncosh2/3 + ^ln(3 + cosh4/3)} (3.6) 

The functions fa and /^^ of the 2d spin glass are shown in fig 1. At difference with the 
annealed case the entropy of the constrained annealed system never becomes negative. 
We have thus obtained a real qualitative improvement. 

It is also interesting to consider the heat capacity C which can be explicitly 
computed. For (3 ^ 00 one has 

C ~ /J^e-'^'^ (3.7) 
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The argument of the exponential has been conjectured in [11] for the quenched model 
and it is different from the exact one-dimension result where the argument is —2(3. 
Note that the annealed system also gives C ~ exp(— 2/?). 

Finally, since we have fixed only one half of the single plaquette frustration, it is 
reasonable to ask what is the residual frustration (f)ac- Since the black plaquettes have 
zero frustration, this quantity will be one half of the frustration of a white plaquette. 
The four couplings forming a white plaquette are independent since they are not 
coupled by the Lagrange multiplier. Therefore, the white plaquette frustration can be 
written as — << Jj >>^, and the global frustration (p^c reads: 

0ac = — « Ji »^ (3.8) 

where << • >> is an average on the Gibbs measure associated to the Grand-partition 
function (3.3). One has therefore 

« J, »= (3.9) 

where /i* is the value which maximizes g{P, //), and the factor 1/2 stems from the fact 
that the total number of couplings is 2N. Since 

and since the derivative with respect to vanishes, one has 

«J.»=-^^^^ (3.10) 
Using the expression (3.6) for /^^ we can compute the residual frustration 



1^41 



= -77 << Ji » = -- 



th{2p) ^ th{2p) 



4-2th2(2/?) 



4 



(3.11) 



2 2 

At zero temperature (pac — 3'^/2^ ps 0.158. This result indicates the presence of a small 
but non vanishing residual frustration. An analogous expression can be found from 
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the annealed free energy /„. In this case all plaquettes can have negative frustration 
and one has 

(j)a = - «Ji»^= -th^(/?) (3.12) 

where the average is in the Gibbs measure generated by the annealed average. The 
frustration 0(j(T = 0) = — 1 since at zero temperature the spins are aligned and the 
annealed system is completely ferromagnetic. Both (f)a and (^ac are reported in Fig 
2. The fact that in the constrained annealed model the residual frustration does not 
vanish indicates that the free energy estimate could be improved by further constraints 
as we shall discuss in the next section. 

4. Constraints without Lagrange multipliers 

As far as we know, up to now constrained annealing has been performed only 
using Lagrange multipliers. This is a strong limitation, since in most cases it is too 
difficult to derive analitically an annealed average using more than one constraint. 
The spin glass with dichotomic couplings has some algebraic features which permit us 
to introduce an alternative method, in order to obtain constrained annealed averages 
avoiding in this way the problem of the minimization of the Lagrange multipliers. 

Let us consider a d-dimensional lattice of N points: the total number of the 
couplings is dN , but the system can be fully described by a lower number of 
independent random variables. In fact the non-trivial part of the quenched free energy 
(2.6) is a function of the variables {t^P}-, see (2.4c) , defined on the closed loops of the 
lattice. Indeed, from a topological point of view any closed loop Ls can be thought 
as the union of some elementary square plaquettes, say a number k, so that the related 
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variable ts can be written as: 

fc ^ 

e) = tanh7/?) 114^ (4.1) 

where we have introduced the frustrations Jp = Y[i=i Ji = with equal probability 
of the k plaquettes (the index i runs over the four sites of each square). Let us stress 
that a loop can be either connected or disconnected, i.e. it is not necessary that 
the plaquettes are neighbours. Notice that the plaquette frustration was previously 
defined with a minus sign (see (2.10)), but in this context we neglect it to simplify the 
notation. Moreover, we dot not assume periodic boundary conditions in this section. 

In other terms, we can consider the plaquette frustrations as the random variables 
of the system, instead of the couplings, with no loss of generality. We shall see that 
the number of frustrations necessary for a full description of the system is always lower 
than dN, the total number of couplings. For instance, in 2d, there are 2N couplings, 
while the number of plaquette frustrations is of order N when N ^ oo. 

However, the 2d case exhibits a special feature, since all the possible plaquette 
frustrations turn out to be a set of independent random variables (let us recall that 
we do not assume periodic boundary condition). In the general case d > 3, this 
statement is no longer valid. Indeed, let us consider a cube in a (i-dimensional lattice: 
a moment of reflection shows that the product of the related six plaquette frustrations 
has to be 1, so that only five frustrations are independent random variables. As a 
consequence, for d > 3 the change of random variables from the couplings to the 
plaquette frustrations involves only a subset of them, let us say N*, chosen in such 
a way that they are independent random variables and that they can build up every 
possible closed loop on the lattice. 

Let us illustrate this change of random variables for a 3d lattice of N points, 
where we can introduce three integer coordinates {x,y,z}. A square plaquette has 
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three different orientations, belonging to a a; = const plane, or y = const, ot z = const. 
In the thermodynamic limit one has A^^ planes for each orientation, and every plane 

2 

is a set of plaquettes, for a total number of 3N plaquettes in the whole lattice. 

Consider a cube of six plaquettes, with one of them on the z = plane. 
As previously discussed, one of the J's cannot belong to the subset of plaquette 
frustrations that describe the whole system, let us say the frustration of the plaquette 
on the z = 1 plane. Let us now consider the other cube sharing this 'neglected' 
plaquette. By introducing as random variables of the system the frustrations which 
are related to the four plaquettes that share a coupling with the plaquette on the 
z = 1 plane, we have to neglect the sixth frustration of the plaquette on the z — 2 
plane, since the product of all the plaquette frustrations of these two nearest neighbour 
cubes is fixed to 1 (the presence of the plaquette on 2; = 1 in the product is irrelevant, 
since it appears twice). These arguments can be easily repeated, so that the subset of 
plaquette frustrations that fully describes the whole system can be found as follows: 
one has to consider two distinct orientations and to take into account all the plaquettes 
with these orientations, for a total number of 2A'". Moreover, the third orientation 
gives only a plane of Na plaquettes (the z — plane in our example), so that in the 
thermodynamic limit the number of independent random frustrations N* that fully 
describe the systems grows as 2A''. 

The generalization of this result is immediate: in the thermodynamic limit the d- 
dimensional lattice of N points (with d > 3) is built up by A?" ^ ^ ^ distinct plaquettes, 

since ( 2 ) number of different orientations for a plane in the lattice, but only a 

number N* = of plaquette frustrations is necessary to describe the system. In fact 
the change of random variables involves only the frustrations of the plaquettes with two 
well-defined orientations {2N plaquettes), together with a plane of plaquettes for each 
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one of the other orientations, but in the thermodynamic hmit the main contribution 
to N* comes from the former term. Using this subset of plaquettes, whose related 
frustrations are all independent random variables, it is possible to build up every 
possible closed loop on the d-dimensional lattice. 

In conclusion the described change of variables permits us to reduce the number 
of independent random variables necessary to describe the system, from dN couplings 
to N* frustrations, with N* = N for d^2 or N* = 2N for d > 3. In the following, if 
not differently specified, the term 'frustration' always indicates one of the N* random 
variables of the system. 

Recalling (4.1), equation (2.6) becomes: 

F = \im ln[l + J] J] 4''^ • ■■Jp"^ tanh^(*i (/5)] (4.2) 

fe=l ii-.-ik 

where one considers all the products of e [1, N*] elementary plaquettes ( the indices 
h ^ ^2 ^ ■ ■ ■ ^ ik run from 1 to N*) and r{ii, . . . ,ik) is the length of the loop 
built up by the k plaquettes, while the over line represents now the average over the 
frustrations. 

In the following paragraph, we consider the plaquettes of the lattice only from a 
topological point of view, i.e., the fact that a frustration of a plaquette is a random 
variable of the system (or not) is irrelevant. At this point, we perform a decomposition 
of the set of plaquettes into subsets such that each coupling Jjj belongs to one and 
only one of these subsets. It follows that two distinct subsets can have in common 
only isolated lattice points. For instance, three different decompositions of the bonds 
of a 2d lattice (the black regions) are illustrated in fig 3. It is worth stressing that, 
after the decomposition, we get a collection of sub-systems which do not cover the 
whole original lattice, e.g. in fig 3a only one half of the 2d lattice is covered. This 
kind of decomposition divides the plaquettes into two classes: the 'black' ones, which 
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are organized in groups corresponding to the sub-systems (e.g. the crosses in fig 3b), 
and the 'white' ones, which do not belong to any sub-system. 

Coming back to the frustrations, note that in general there are many 'white' or 
'black' plaquettes whose frustration is not a random variable of the system. 

At this point we can derive an upper estimate Fac of the function (4.2), by treating 
all the random variables of frustration associated to the 'white' plaquettes as annealed 
variables, i.e. by averaging over these variables only the argument of the logarithm in 
(4.2), instead of the logarithm itself: 

(6) 

Fac^ lim ^ln[l + V V J^^..4''=) tanh^(^^'-'^'=)(/3)] (4.3) 

fc=l ii...ifc 

where ~m~^'^^ and ~m~^^^ represent the averages over the frustrations related to, 

respectively, the 'white' and the 'black' squares. In (4.3) only the terms Jp^^ . . . Jp^^ 

with all 'black' frustrations do not vanish after performing the 'white' average: 

(b) 

Fac= lim -ln[l + V V 4^^^ . . . 4^'=^ tanh'^(^i'-'^'=)(/3)] (4.4) 

AT— »oo iV '-^ 

where now the indices ii, . . . ,ik run only over the Ni, 'black' frustrations. It should be 
remarked that after performing the 'white' average, the surviving loops do not connect 
different sub-systems. In other terms, any loop appearing in the average (4.4) can be 
decomposed into a set of 'sub-loops', each of them limited to a single sub-system. 
This implies that tanh''^*^'''**'-'(/3) can be factorized, i.e., r(ii,...,ifc) is the sum of 
the lengths of the various 'sub- loops'. As a consequence, the whole argument of the 
logarithm in (4.4) is factorized among all the sub-systems, and it immediately follows: 

rJ ^ I I 

Fac = - ln[l + E E -^P'^ ■ ■ ■ Jp"^ tanh^^^^'-'^'=)(/3)] (4.5) 
■I k=l n-.-ik 

where the average is performed over the Hp 'black' plaquette frustrations that belong to 
a single sub-system, and where rij is the number of couplings in the sub-system, so that 
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^ represents the total number of sub-systems, rescaled with N in the thermodynamic 
limit. Recalling (2.5), from (4.5) the lower estimate fac of the quenched free energy 
yields: 

rJ ~ ~ 

-/3/„^ = d lncosh(/3) + — ln[l + V V A'^K . . 4''h8.nh'^^'''-"'\(3)] +ln2 (4.6) 

It is preferable to choose a topological decomposition of the system such that the 
Up 'black' frustrations fully describe the single sub-system. In this context Fac is 
practically equivalent to the quenched free energy of the sub-system, a part a factor 
proportional to In cosh /3. If Up is not too large, the computation of Fac can be 
performed analitically or numerically. 

The correct multiplicative factors to transform the quenched free energy of a sub- 
system to the global constrained free energy (4.6) can also be obtained by a simple 
argument. Indeed the partition function Z^^ of a sub-system made of spins and rij 
couplings is the sum of 2'^" terms which are given by the product of rij exponentials 
while the global constrained Grand-partition function fijv of a system with N spins 
and dN couplings is the sum of 2^ terms which are given by the product of dN 
exponentials. In order to compare two quantities of order one, one has to write the 
following equality: 

(2-^l]iv)^ = (2-"«Z,J^ 

so that 

/ac = -^(l-rf-) ln2 + d'^fsub. (4.7) 
/? rij Uj 

This formula is completely equivalent to (4.6), but has the advantage that the 
quenched free energy fgub of the sub-system explicitly appears. The ground state 
energy can be estimated by the saddle point method when P —>■ oo in the quenched 
average of Z^^ : 

Eac{T = 0) = — max iy({J}) (4.8) 

Uj {a} 
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where the maximum is taken over all the a configurations for each disorder realization. 
One can also obtains the residual entropy as 

ft 

Sac{T = 0) = (1 - —d) ln2 + \ndeg{{J}) (4.9) 
no- 
where deg{{J);) is the number of disorder configurations which have energy H{{J}) 

equal to EaciT = 0). 

Let us briefly resume the discussion, in order to clarify the meaning of the result. 
Using a topological decomposition of the system into independent sub-systems, we 
have derived a lower estimate of the quenched free energy that depends from the 
quenched free energy of the single sub-system. As discussed in the appendix, the 
quenched free energy of a sub-system can be obtained by a minimization of an annealed 
average of the Grand-partition function with Lagrange multipliers over all its possible 
loops. Using our procedure, we are able to get the annealed average fac of the 
global system where the constraints are imposed over all the possible rescaled sums 
of frustration on all the loops that appear in the various sub-systems. 

To illustrate our method, we apply it in the case of sect 3, i.e. the decomposition 
of a 2d spin glass in 'white' and 'black' square plaquettes, like in a chessboard, see fig 
3a. In this case all the N plaquette frustrations represent a set of independent random 
variables, i.e. N* = N. One half of them is related to 'white' plaquettes, so that they 
are treated as annealed variables, while the other half related to 'black' plaquettes as 
quenched variables. We also have rij = 4 and np = 1, so that (4.6) becomes: 

= 2 lncosh(/3) + i ln[l - tanh^(/3)] + ln2 (4.10) 

It is easy to check that after trivial algebraic manipulations one gets again (3.6). 

The ground state energy and the zero temperature entropy can be directly 
computed from (4.10), and respectively are: 

£;^^(T = 0) = -1.5 S^J,{T = 0) = (4.11) 
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The method of constrained annealed averages without multiphers can be apphed to 
non-elementary sub-systems in an easy numerical way, since one has not to introduce 
a set of corresponding Lagrange multipliers. In order to improve (4.10) and (4.11), we 
have considered a partition of the 2c? lattice into independent crosses of np = 5 square 
plaquettes, as shown in fig 3b. We thus obtain a constrained annealed average where 
all the relevant variables on the non connected loops inside the crosses are frozen. 
Since rij = 16, from (4.6) the free energy is easily evaluated, and is shown in fig 1. 
The ground state energy and the residual entropy are respectively 

E^l{T = 0) = -1.484375 S^iT = 0) = 0.00882... (4.12) 

The next step is to considered the elongated cross of the type shown in fig 3c 
{up = 8 and rij = 24). In this case we get 

El^J(T = 0) = -1.477865 Sl^J{T = 0) = 0.0130... (4.13) 

At increasing the size of the subsets of the decomposition, the convergence to the 
quenched ground state energy Eq is rather slow as the numerical result of [11] gives 
Eq = -1.404 ± 0.002 and Sq = 0.075 ± 0.004). However, the main qualitative feature 
(positive residual entropy) is reproduced by our approximations. 

We have also applied our technique to the ± J spin glass in three dimensions. From 
a topological point of view, a 3d lattice with N points can be thought as the union of 
distinct cubes distributed in such a way that two of them have only one lattice point 
in common (the 3d equivalent of the 2d chessboard) . In the thermodynamic limit their 
number is ^N. Let us stress that in this case the six plaquettes of each cube represent 
the 'black' regions for a total of ^N, while there are 'white' plaquettes between 
cubes. 

It is easy to realize that there exists a different, but equivalent, change of random 
variables with respect to the one previously described, which involves Up = 5 'black' 
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plaquette frustrations for each cube (the neglected plaquette must be always the 
same), together with other plaquette frustrations in the 'white' areas, for a total 
of independent random variables. After performing the 'white' annealed average, 
the problem is reduced to the calculation of the quenched free energy of a single 
cube. In this case we obtain a constrained annealed average of the free energy of the 
global system /^"''^, where the constraints are imposed over the products of the J^-'s 
on all the closed loops of bonds in the jN independent cubes. The resulting Z™''^ 
has a very long analytic expression and is plotted in fig 4, where it is also drawn 
for comparison the annealed free energy. Unfortunately, the residual entropy is still 
negative, thus indicating that in three dimensions more constraints are necessary to 
get a fair approximation of the quenched system at low temperature. However, the 
free energy should be a non-decreasing function of the temperature, so that the ground 
state energy can be estimated as the supremum of an annealed approximation although 
the free energy has negative derivative at low temperature [5]. Our constraints on 
all the loops inside the alternated cubes allows to estimate Eo{d = 3) > —1.917 
which improves the lower bounds given by the supremum of the annealed free energy, 
Eo > -1.956 

5. Constrained annealed averages on infinite loops 

The method introduced in the previous section could allow us to obtain very accurate 
estimates (lower bounds) of the quenched free energy. Indeed the main limitation we 
have met is that the number of plaquettes Up of the sub-system should be not too large 
in order to perform an analytic calculation of its quenched free energy. For instance 
in 2d we have stopped the estimates at the elongated cross with Up = 8 plaquettes. 
However, we can consider infinite loops by estimating the free energy of sub-systems 
of infinite size only in one direction, via the Lyapunov exponent of the product of 
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random transfer matrices [12]. 

To simplify, let us consider again the two dimensional Ising model with = ±1 
with equal probability, although our discussion can be extended to three and higher 
dimensions. The idea is to find an independent decomposition of the 2d lattice in strips 
of size L. We then compute the quenched free energy of the strip as the Lyapunov 
exponent of the infinite product of random transfer matrices of size 2^ x 2^. In such 
a way, we automatically obtain the annealed average where the products of J^'s on 
all the possible loops inside the strip are constrained to their quenched mean value. 
In particular, some of the loops are of infinite size in one direction. Our proposal 
requires a numerical calculation of the Lyapunov exponent, but it is superior to the 
direct application of the transfer matrix method [13], since it allows one to obtain 
lower bounds of the free energy which become more and more accurate at increasing 
the size L of the strips, as a consequence of the standard inequalities satisfied by the 
constrained annealed averages. 

In order to reduce the number of random variables, it is convenient to perform 
a gauge transformation, before computing the free energy of the spin glass. In two 
dimensions, we have chosen a gauge transformation which map the original system 
into a new one where the horizontal couplings are i.i.d. random variables (Jy = ±1 
with equal probability) and the vertical couplings are positive and constant (Jij = 1). 
We consider strips of L spins which are parallel to the bisectrix of the lattice as shown 
in fig 5, in order to obtain a convenient independent decomposition of the lattice with 
the properties discussed at the beginning of sect 4. The basic cell of the strip is formed 
by three layers, the first and the third ones of length L and the intermediate layer of 
length L + 1. We denote by a the spins of the first layer, ^ the spins of the second 
layer and r] the spins of the third layer. The particular form of the strip allows one to 
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perform a preliminary analytic integration over the spins of intermediate layers. For 
instance, the case L = 3 is illustrated in fig 5. The partition function of that strip 
can be obtained by a product of transfer matrices between the first and the third spin 
layers: 

N 

Zn{L = 3) = Tr J] T(i; Ji, • • • , Je ) (5.1) 

i=l 

where there are 2^ different random transfer matrix T. As the Boltzmann factor 
ex.p{—PH) of three consecutive layers of the L = 3 strip is 

exp(cri^i + (72^2 + CTs^s) exp(Jicri^2 + J2cr2C3 + JsCTsU) 

exp(?7i^2 + V2^3 + exp( J4?7i^i + 757726 + JeVa^a) 

one immediately sees that, after integrating out the intermediate lay (the four ^ spins), 
the elements of the 8x8 transfer matrices are 

COSh((7i + J4?7l) COSh(Ji(Ti +75772 + (72 +771) COsh( J2(J2 + JeVS + (^3 + V^) COSh( JsiTs + 773) 

(5.2) 

The extension to a generic value of L is straightforward, and one has to deal with the 
product of 2^^ independent random matrices of size 2^ x 2^. 

The Lyapunov exponent A of the product of the transfer matrices is related to the 
quenched free energy fgfj^p [12] by: 

A = -nsPf^sSip (5-3) 

A moment of reflection shows that there are Ug = 2L + 1 spins and rij = 4L couplings, 
so that from (4.7) one obtains the constrained annealed free energy fic^ of the total 
system: 

-/3/i? = ^ (8.4) 
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The constrained free energy as function of the temperature forL=l,L = 2,L = 3 
and L = 8 is shown in fig 6. It is evident that the difference between the constrained 
annealed free energy fac^ and the quenched one increases at lowering the temperature, 
since the frustration effect becomes more and more important. In two dimensions 
at varying the size of the transversal length L we found a monotonous convergent 
sequence of approximations from below to the ground state energy and to the residual 
entropy: 
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In conclusion, we have shown that the constrained annealing in ±J spin glasses 
can be performed without Lagrange multipliers, by performing quenched averages on 
appropriate sub-systems. However, it is an open problem to extend it to other coupling 
distributions such as the gaussian distribution. 

Acknowledgements 

GP and MS acknowledge the financial support (Iniziativa Specifica FI3) of the 
I.N.F.N., National Laboratories of Gran Sasso, Gruppo coUegato deU'Aquila. 

22 



Appendix: How many Lagrange multipliers for the quenched free energy? 

Strictly speaking, the method of Lagrange multiphers, as formulated in [1] shows 
that computing an annealed average of the partition function with some constraints 
which hold in the thermodynamic limit is equivalent to determining the maximum of 
an appropriate Gibbs potential g{P,fj,) with respect to fx. Let us note that in general 
IJ, indicates a whole set of Lagrange multipliers. Actually, this method suggests a 
clever way to calculate a quenched average, by finding the minima of annealed models 
with Lagrange multipliers even in finite volume systems. However, in this case, the 
Lagrange multipliers do not constrain the variables ctjv to their mean value. Only in 
the thermodynamic limit these constraints are achieved by a saddle point estimate of 
the annealed average of the Grand-partition function. In both cases (finite or infinite 
volume systems) the most interesting question is to establish how many and what 
quantities are necessary to reproduce a quenched average. In this appendix we give 
an explicit answer. We limit our considerations to the case of a single random variable 
X, since the following arguments can be easily extended to many or infinite variables. 
Let us suppose that x is defined over a set X with a probability density p{x), and let 
Z{x) > be a function of x such that the quenched average lnZ{x) exists finite. One 
has the following theorem: 

Theorem: Assume there is a set of n functions {0:1(0;), . . . , an{x)} and a set of 
n + 1 constants {cq, . . . , c„} such that: 



n 




{Al) 



i=l 



on X. Then the quenched average liiZ{x) is equal to: 



n 



hiZ{x) = min In Z{x) exp —/ ^fJ'i { <^i{x) — ai{x) 




and the minimum is reached for {jii = Cj}j=i^...^ 
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Proof: Recalling (Al), from a direct inspection it follows that the right hand side 
of equation (A2) is equal to InZ(x) for {/x^ = Ci}i=i,...,n- By virtue of the convexity 
of the logarithm the proof is completed. Let us stress that, in general, there is an 
infinite number n of functions {ai{x)}. 

This result, i.e. that a quenched average is formally equivalent to a variational 
annealed problem, was first established by Morita [2], using, indeed, a different 
variational approach with respect to relation (A2). 

This simple theorem can be usefully applied in the case of finite systems with 
dichotomic disorder. Let us consider, for instance, a 2d Ising spin glass with nearest 
neighbours random couplings {J^ = ±1}. As previously seen, the partition function 
Zjv of the system of N spins depends only on the plaquette frustrations {Jp^}, which 
are a set of independent dichotomic (±1) random variables (no boundary conditions 
are assumed). Prom elementary properties of the dichotomic variables, the free energy 
Un = Ib-Zn of a realization of the system can be written as: 

L(4) L(6) L(8) 

where there are different terms with the same number of plaquettes in the product, 
according to the length of the resulting loop built up by these plaquettes. For instance, 
there are three terms by the sums of products of three plaquettes, corresponding to 
loops of length 8,10 and 12. Thus the quenched free energy can be recovered with an 
annealed average of type (A2) where every possible function 

1 {A3) 

^r(ii,...,ij.) 

appears with its Lagrange multiplier. In the thermodynamic limit (A^ — oo) this 
means that the quenched free energy is equal to an annealed free energy where the 

24 



frustration computed along every kind of closed loop on the lattice is constrained to 
its mean value. 

This last statement keeps its validity for a generic distribution of the couplings, 
taking into account that the frustrations along the closed loops should be substituted 
for the more generic variables {t^f^} defined by (2.7). In other terms, the general 
quantity to constrain (corresponding to (A3) for the dichotomic case) is: 



The proof can be achieved by arguments derived from the large number law. On the 
contrary, for a finite size system it is not sufficient to perform an annealed average 
with constraints over all the quantities (A4) to recover the quenched free energy, at 
difference with the dichotomic case. Indeed, the ± J spin glass has a special feature, 
i.e., both the partition function and its logarithm can be expressed in terms of only 
the quantities (A3), by virtue of the dichotomic properties of the random variables, 
while for a generic distribution only the partition function can be written as sum of 
the quantities (A4). However, in principle one can get an expression of the logarithm 
of the partition function recurring to power series of the (A4)'s, and, as a consequence, 
one can find all the quantities to constrain in order to obtain the quenched free energy 
for a finite volume system. 




(A4) 
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Figure Captions 



Fig. 1 ± J spin glass in 2d: the annealed free energy /„ (dashed line) and the constrained 
free energies (full line) and /^^ (dot-dashed line) versus temperature T = 1/(3. 
The constraints are imposed, respectively, on N/2 independent plaquettes and on 
N/^ independent crosses of five plaquettes. 

Fig. 2 ±J spin glass in 2d', residual frustration (3.12) for the annealed model and (/)(jc 
(3.11) for the constrained model. The constraint is imposed on N/2 independent 
plaquettes. 

Fig. 3 Ising model with nearest neighbour interactions on a 2d lattice: decompositions of 
the set of the couplings in independent subsets (the black areas): a) squares, b) 
crosses and c) elongated crosses. 

Fig. 4 ±J spin glass in M: the annealed free energy fa (dashed line) and constrained 
free energy f^c^^ (full line) versus T = 1//3. 

Fig. 5 Ising model with nearest neighbour interactions on a 2d lattice: 

a) decompositions of the set of the couplings into independent subsets of infinite 
area (the black strips) in the case L = 3. 

b) the basic cell of the strip (L = 3) is formed by three layers: cr, ^ and r] spins; 
after the gauge transformation the vertical couplings are fixed (J^ = +1, full lines) 
and the horizontal couplings are random (J^ = ±1, dashed lines). 

Fig. 6 ±J spin glass in 2d: quenched free energy of the system obtained by a 
decomposition of the lattice into independent strips, as function of the temperature 
T at different widths L = 1, 2, 3, 8 of the strips. 
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